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DISCRETE-EVENT-DYNAMIC-SYSTEM-BASED  APPROACHES  FOR  CONTROL 
IN  INTEGRATED  VOICE/DATA  MULTIHOP  RADIO  NETWORKS 


1  Introduction 

This  report  contains  the  results  from  our  work  under  contract  N000014-92-J-2017  for  the  period 
10/1/92  -  9/30/93.  It  describes  the  progress  made  towards  the  effort  to  develop  and  apply  new 
discrete-event-dynamic-system-based  techniques  for  the  transmission  scheduling  problem  in  Radio 
Networks  (RN).  The  report  is  in  two  parts:  in  part  one  we  examine  the  transmission  scheduling 
problem  in  the  context  of  (fixed  length)  data  traffic.  In  contrast  to  our  earher  work,  performed 
under  contract  N000014-91-J-2025  [3,  4],  which  dealt  with  the  broadcast  scheduhng  problem  in  a 
fuUy  coimected  packet  RN,  the  first  part  of  this  report  extends  the  proposed  methodology  therein 
to  general  topology  networks.  In  part  two,  we  look  at  the  scheduling  problem  when  processing 
packetized  voice  caUs^  in  a  N-node  multihop  RN.  As  wiU  be  seen,  the  different  Grade-of-Service 
(GOS)  requirements  associated  with  voice  and  data  traffic  lead  to  two  decidedly  different  scheduhng 
pohcies.  We  begin  with  a  brief  review  of  the  transmission  scheduling  problem  in  N-node  Radio 
Networks. 

In  such  networks  there  are  N  nodes  that  wish  to  broadcast  over  a  common  chaimel.  In  order 
for  a  node  to  successfully  transmit,  the  following  primary  interference  constraint  must  be  satisfied: 
if  node  i  transmits,  then  all  nodes  that  are  within  node  i ’s  broadcast  zone  must  be  in  a  receiving 
mode.  Thus,  edl  such  nodes  j  are  viewed  as  “neighbors”  of  z,  coimected  to  i  through  finks  {i,j). 
In  addition,  there  may  be  a  secondary  interference  constraint,  whereby  if  i  is  transmitting  and 
j  is  connected  to  i,  then  all  nodes  k  that  are  also  connected  to  j  must  be  in  a  receiving  mode; 
otherwise,  a  {k,j)  trcinsmission  interferes  with  the  (i,  j)  transmission.  In  short,  there  eire  (generally 
overlapping)  subsets  of  the  N  nodes,  known  as  transmission  sets,  such  that  all  nodes  in  such  a  set 
can  simultaneously  transmit  without  conflict  (i.e.  without  violating  the  interference  constraints). 
Given  a  slotted  time  fine,  the  problem  becomes  the  assignment  of  each  time  slot  to  a  particular 
transmission  set  [10,  9,  18,  20,  23]  so  that  some  desirable  performance  can  be  attained. 

There  have  been  several  approaches  for  solving  the  transmission  scheduling  problem  (see 
references  in  [3]),  however  here,  as  in  [3,  4],  an  alternate  approach  is  proposed  which  uses  on-line 
adaptation  of  the  schedule  (in  a  stochastic  operating  environment),  to  achieve  the  desired  system 
performance.  An  important  distinction  between  the  existing  literature  and  the  work  reported  here 
and  in  [4]  is  that  no  distributional  information  at  all  about  the  arrival  processes  at  the  various 
network  nodes  is  required. 

As  described  in  [4],  the  transmission  scheduling  problem  can  be  placed  in  the  context  of  a 
“polling”  system  where  the  channel  is  modelled  as  a  single  resource  (server)  which  provides  service 
to  a  set  C  of  transmission  sets.  At  each  network  node  i,  z  =  1, ...,  N ,  there  is  a  customer^  arrival 
stream  characterized  by  arbitrary  interarrival  time  distributions  Gi  with  rate  A^.  Let  A  denote  the 
set  of  arrival  streams.  Note  that  we  allow  for  correlation  within  an  individual  queue  arrival  stream, 

’In  this  report  it  is  assumed  a  voice  call  is  comprised  of  an  arbitrary  number  of  fixed-length  packets,  with  constant 
interarrival  times. 

^The  term  “customer”  can  refer  either  to  a  data  packet  or  to  an  entire  voice  call. 
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as  well  as  between  streams.  A  customer  from  a  particular  arrival  stream  is  allowed  to  join  one  of 
several  prespecified  transmission  sets  associated  with  that  stream.  Therefore,  a  transmission  set 
Ci  is  such  that  Ci  C  A  and,  in  general,  C,-  fl  Cj  7^  0  for  i  j-  The  importance  of  the  distinction 
between  “transmission  set”  and  “arrival  streams”  is  the  following:  when  the  server  is  allocated  to 
a  transmission  set,  it  can  serve  multiple  customers  simultaneously,  one  from  every  arrival  stream 
that  can  belong  to  this  set.  As  an  illustration,  consider  the  four-node  RN  with  three  transmission 
sets  shown  in  Figure  la.  The  equivalent  polling  representation  is  shown  in  Figure  lb,  where,  a 
customer  from  arrival  stream  2,  for  example,  may  join  either  transmission  set  1  or  2.  In  the  latter 
model,  a  customer  is  held  at  the  head  of  its  arrival  stream  queue  until  the  server  is  assigned  to 
either  transmission  set  1  or  2;  it  is  then  instantaneously  transferred  to  the  appropriate  queue  and 
served  (while  another  customer  from  another  arrival  stream  may  also  receive  service  at  the  same 
time).  We  assume  that  time  is  slotted  (with  slot  size  set  equal  to  the  packet  trajismission  time), 
such  that  a  scheduling  decision  is  made  at  the  beginning  of  every  slot.  The  rule  by  which  the  server 
is  assigned  to  a  particular  queue  is  known  as  a  polling  policy. 

The  choice  of  an  appropriate  polling  poUcy  is  governed  in  part  by  the  traffic  GOS  require¬ 
ments.  Data  traffic  is  characterized  by  a  tolerance  in  the  end-to-end  packet  delays,  but  no  tolerance 
in  packet  loss.  Therefore,  in  packet  RN  we  assume  infinite  buffers  at  each  network  node  and  such 
that  packets  can  be  queued  with  no  additional  penalties.  Our  objective  is  then  to  select  a  polling 
policy  so  as  to  minimize  the  mean  packet  waiting  time.  In  contrast,  packetized  voice  traffic  can 
tolerate  some  loss  (without  a  severe  deterioration  in  the  voice  playback),  however  it  is  sensitive  to 
end-to-end  delays.  In  addition,  it  is  desirable  that  packets  reach  the  destination  in  the  order  in 
which  they  are  transmitted.  Assume  that  the  desired  GOS  for  voice  calls  can  be  expressed  in  the 
form  of  a  stringent  upper  bound  on  the  end-to-end  delay  of  packets  belonging  to  a  voice  call.  Thus 
we  deal  with  the  problem  of  serving  delay-sensitive  traffic  in  the  following  sense:  packets  cannot 
be  queued  for  more  than  n  time  slots,  where  n  is  fixed.  Thus,  upon  arrival,  a  voice  call  is  either 
accepted  if  this  constraint  can  be  satisfied,  or  it  is  blocked.  Blocked  caRs  are  assumed  to  be  lost 
from  the  system,  a  mode  of  operation  known  as  ‘blocked  caRs  cleared’  The  objective  then  is  to 
determine  the  polling  policy  that  minimizes  the  probability  that  a  voice  caR  is  blocked. 

For  RN’s  with  data  traffic,  as  discussed  in  [3],  we  consider  a  non-cychc  polling  policy,  in 
particiRar,  a  non-work  conserving  probabilistic  policy  with  zero  switchover  times,  where  the  current 
time  slot  is  assigned  to  transmission  set  i  with  probability  6i.  We  refer  to  this  poRcy  as  ‘random 
polling’.  The  ^,’s  then  represent  control  parameters,  which  can  be  gradually  tuned  or  optimally 
selected  so  as  to  achieve  a  desired  system  performance.  In  scheduling  delay  sensitive  voice  traffic 
we  consider  a  cyclic  policy,  where  the  polling  cycle  is  specified  by  a  frame  comprised  of  n  slots,  such 
that  a  slot  is  uniquely  assigned  to  a  particular  transmission  set.  Thus,  a  frame  is  characterized  by 
a  vector  [ci,  •  -  • ,  c^]  where  Cj  G  {1,  •  •  • ,  M}  is  the  transmission  set  assigned  to  slot  i  and  M  =  \C\ 
where  |  •  |  is  the  cardinality  of  a  set.  Note  that  the  frame  structure  aRows  us  to  guarantee  an  upper 
boimd  on  the  intervisit  time  to  any  transmission  set.  In  the  case  of  delay-sensitive  traffic,  we  can 
therefore  ensure  that  no  transmission  set  ever  waits  for  more  than  n  time  slots. 

In  contrast  to  random  polling,  the  scheduRng  problem  under  cyclic  poRing  is  formiRated  as  a 
stochastic  discrete  optimization  problem  over  a  finite  set,  and  is  an  instance  of  the  general  stochastic 

policy  is  work  conserving  or  nonidling  if  the  server  is  assigned  to  a  transmission  set  if  and  only  if  there  are 
customers  present  in  one  of  the  arrival  streams  belonging  to  that  transmission  set. 
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Transmission  sets: 


Figure  la :  4-Node  RN 
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Figure  lb:  Multiclass  Polling  System 
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resource  allocation  problem  where  n  resources  (slots)  are  to  be  assigned  to  M  users  (transmission 
sets).  Rather  than  solve  the  original  discrete  optimization  problem,  which  can  easily  become 
combinatorially  explosive,  we  propose  a  new  approach  [6]  whereby  we  transform  the  former  into  an 
auxiliary  continuous  optimization  problem,  which  in  turn  can  be  solved  quite  efficiently  through 
various  gradient-based  algorithms.  Finally,  the  choice  of  a  state-independent  scheduling  policy  is 
motivated  by  the  simplicity  of  the  controller,  i.e.,  the  fact  that  no  monitoring  of  state  information 
(queue  lengths)  is  involved.  In  fact,  in  many  complex  systems,  including  radio  networks,  it  is  often 
the  case  that  state  information  is  either  impossible  to  obtain  or  it  may  not  be  up-to-date  for  a 
real-time  controller  to  use. 

The  remainder  of  the  report  is  organized  as  follows.  In  section  2  we  present  a  formulation  of 
the  transmission  scheduling  problem  w  ith  <>verlapping  transmission  sets  in  the  presence  of  data  traf¬ 
fic.  This  formulation  reveals  the  need  for  estimates  of  the  sensitivities  (gradient)  of  the  performance 
measure  with  respect  to  the  slot  assignment  probability  parameters  6i,  based  on  which  simple  on¬ 
line  optimization  algorithms  are  proposed.  We  present  one  such  estimator  for  the  case  where  the 
performance  measure  is  the  mean  packet  waiting  time.  In  section  3,  we  present  a  gradient-based 
optimization  algorithm  for  obtaining  optimal  slot  assignment  probabilities  using  our  approach  for 
several  networks,  including  examples  illustrating  the  adaptive  features  of  the  approach.  In  section 
4,  our  aim  is  to  use  our  approach  to  subsequently  obtain  a  deterministic  (non-randomized)  sche¬ 
duling  poHcy,  thus  avoiding  the  randomization  in  the  slot  assignment  process.  We  develop  such  a 
deterministic  policy  using  the  Golden  Ratio  policy  proposed  in  [15],  and  compare  it  with  several 
other  policies,  including  a  simple  Round  Robin  one.  In  section  5  we  consider  the  problem  of  serving 
delay-sensitive  voice  traffic.  In  section  6  we  formulate  the  optimal  scheduling  problem  as  a  stocha¬ 
stic  resource  allocation  problem,  and  describe  how  we  transform  the  ensuing  discrete  optimization 
problem  to  a  continuous  optimization  problem.  This  formulation  reveals  the  need  for  estimates  of 
the  sensitivity  (gradient)  of  performance  metrics  with  respect  to  the  control  parameters.  In  section 
7  we  derive  such  estimators  based  on  the  ‘marked  slot’  approach  proposed  in  [4],  and  develop  ex¬ 
plicit  algorithms  for  gradient  estimators  of  blocking  probability  imder  two  modes  of  delay- sensitive 
operation.  In  section  8  we  present  a  convergence  result  which  delineates  the  relationship  between 
the  discrete  optimization  problem  and  the  auxiliary  continuous  optimization  problem.  In  sections 
9  and  10,  we  illustrate  our  methodology  by  discussing  two  applications  which  can  be  modelled  as 
resource  allocation  problems.  Lastly  in  section  11  we  discuss  ongoing  research  problems. 

2  Transmission  Scheduling  Problem  Formulation  with  Overlap¬ 
ping  Transmission  Sets 

Consider  a  iV-node  RN  with  data  traffic.  At  each  node  i,  i  =  l,...,N,  there  is  a  process  charac¬ 
terizing  data  arrivals,  where,  as  before,  we  assume  an  arbitrary  interarrival  distribution  for  data 
packets  and  allow  for  correlations  between  arrivals.  From  a  terminology  standpoint,  we  will  use 
“node”  and  “arrival  stream”  interchangeably.  Our  starting  point  is  to  assume  that  a  finite  number 
of  transmission  sets  (M)  has  been  identified  such  that  all  nodes  in  the  RN  belong  to  at  least  one 
such  set.  Moreover  let  there  be  one  or  more  overlapping  transmission  sets  (i.e.,  a  packet  from  some 
arrival  stream  (node)  may  be  served  in  transmission  set  i  or  j  ^  i).  Let  Zi  be  the  set  of  transmission 
sets  to  which  the  ith  arrival  stream  belongs.  For  example,  in  the  4-node  network  shown  in  Figure 
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la,  node  2  belongs  to  transmission  sets  1  and  2  so  that  =  {1,  2}.  Similarly  Zi,  —  {2,  3}  and  so 
on. 

Let  us  focus  on  average  packet  waiting  time  as  the  cost  function  of  interest,  and  let  0,', 
i—  1,  •  •  ■ ,  M  be  the  probability  that  a  slot  is  assigned  to  transmission  set  i  (assignments  are  made 
independently  from  one  slot  to  the  next).  We  define  0  to  be  the  M-dimensional  slot  assignment 
probability  vector  [0i,  •  ■  -  ,0]^]^  and  Wi(0)  as  the  expected  node  i  waiting  time.  Our  objective  is 
to  determine  the  optimad  slot  assignment  vector  so  as  to  minimize  a  weighted  sum  of  the  mean 
packet  waiting  times  associated  with  each  arrival  stream,  subject  to  normahzation  and  stability 
constraints.  Thus,  the  optimization  problem  is  formulated  as: 

Problem  Pi: 


N  M 

rmnX]CiWi(0)  s.t.  =  l  (1) 

i=i 

where  Ci  is  the  weight  associated  with  stream  i.  In  the  above  problem  formulation  we  do  not 
explicitly  include  the  stability  constraint,  rather,  we  take  this  into  account  in  the  final  optimal 
assignment  by  simply  ensuring  that  every  adjustment  made  to  9i  never  violates  this  constraint. 
Observe  that  the  mean  waiting  2;de  Wi  is  a  function  of  the  probability  that  stream  i  is  assigned  a 
transmission  slot,  which  is  given  by  6j-  This  motivates  the  definition  of  a  new  iV- dimensional 

control  vector  $  with  elements 


ieZi 


(2) 


that  is,  (t)i  is  the  probability  that  a  time  slot  is  assigned  to  a  transmission  set  that  contains  stream 
i  (and  hence  a  packet  from  streaim  i,  if  present,  is  served).  With  the  introduction  of  #,  we  can 
rewrite  Pi  as 

Problem  P2: 

N 

Tmny]CiWi{(f>i)  s.t.  ^i($)  =  Ci,---,5„($)  =  c„  (3) 

where  we  replace  the  single  normalization  constraint  by  one  or  more  constraints  on  the  auxiliary 
variables  which  we  obtain  from  the  N  equations  of  the  form  (2).  From  the  theory  of  Lagrangian 
optimization,  there  are  simple  Kuhn- Tucker  conditions  that  provide  necessary  conditions  for  op¬ 
timality.  If  a  Lagrange  multiplier  is  associated  with  each  constraint  in  P2,  after  eliminating  the 
multipliers  we  obtain  conditions  which  are  typically  of  the  form 


Eft 


d<t>i 


Eft 


fc=i 


dWk{(i>k) 

d^k 


(4) 


for  some  K,  L  <  N .  In  the  absence  of  analytical  expressions  for  Wi(^i),  i  =  —  we  can 

use  standard  gradient-based  optimization  algorithms  (hiU- climbing  or  steepest-descent)  [21,  8]  to 
find  the  optimal  provided  the  gradient  in  (4)  is  available.  The  corresponding  0“  can  then  be 
obtained  as  a  solution  of  the  N  linear  equations  (2).  Alternatively,  since  the  (j>i’s  are  themselves 
variables  dependent  on  0,  we  may  choose  to  control  the  9i's:  thus  the  minimization  may  be  done 
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by  adjusting  0  directly;  an  example  will  be  given  in  the  next  section.  The  coupling  between  the 
transmission  sets  is  now  reflected  in  the  adjustments  of  0,’s  so  as  to  achieve  the  derivative  balance 
required  by  (4). 

The  preceeding  discussion  motivates  us  to  seek  techniques  for  estimating  — by  simply 
observing  the  actual  system  in  operation  (or  by  simulating  it).  Along  these  lines,  two  approaches 
which  have  been  proposed  are  Perturbation  Analysis  (PA)  (e.g.  [11,  14])  and  the  Likehhood  Ratio 
(LR)  methodology  (e.g.  [19, 12]).  In  this  report,  we  apply  PA  techniques  to  estimate  the  sensitivities 
in  question.  The  main  idea  in  PA  is  to  estimate  ^  through  the  sample  derivative 

where  a;))  is  a  sample  function  obtained  when  a  particular  sample  path  is  observed, 

and  Ji{<j>i)  =  £[i,(^(^i,a)))].  Here,  ui  is  an  element  of  the  underlying  probability  space  fl,  which 
is  taken  to  be  [0,  l]°°;  thus,  w  is  simply  viewed  as  a  sequence  of  uniformly  distributed  random 
variables  in  [0, 1].  A  sample  derivative  obtained  through  this  approach  is  an  unbiased  estimate  of 
provided  that  [2] 

(5) 

Since  the  form  of  the  derivative  estimator  is  the  same  for  each  transmission  set,  let  us  concentrate 
on  an  isolated  transmission  set.  In  particular,  the  queueing  system  corresponding  to  transmission 
set  i  behaves  like  a  modified  G/D/1  queue  with  vacations,  where  vacations  correspond  to  periods 
when  the  server  is  imavailable  to  transmission  set  i  (i.e.  the  server  is  busy  serving  packets  from 
other  transmission  sets)  and  service  is  synchronized  to  coincide  with  the  start  of  a  slot.  That  is,  at 
the  start  of  every  interval  of  S  time  units  (i.e.,  each  slot),  the  server  is  available  to  transmission  set 
i  and  with  probability  (1  —  <^i)  the  server  goes  on  vacation.  A  slot  that  is  assigned  to  transmission 
set  i  is  termed  a  ‘transmission  slot’,  otherwise  it  is  termed  a  ‘vacation  slot’.  We  used  the  term 
modified  G/D/1  above,  because  an  arriving  customer  must  always  wait  until  the  end  of  the  slot 
within  which  it  arrives,  even  if  the  server  is  available  (normally,  this  customer  would  immediately 
start  service). 

The  key  idea  on  which  the  estimator  is  based  is  to  evaluate  the  eifect  of  altering  a  given 
schedule  (sequence  of  slot  assignments)  by  converting  one  vacation  slot  to  a  transmission  slot  on 
an  observed  sample  path.  The  vacation  slot  added  to  some  hypothetical  new  schedule  is  termed  a 
phantom  slot.  In  presenting  the  estimation  algorithm  we  define  the  following  sample  path  quantities 
(based  on  a  continuous-time  model): 

•  K  -  Observation  interval  in  number  of  busy  periods 

•  N  -  Number  of  node  i  packet  arrivals  during  observation  interval 

•  Aij  -  Arrival  epoch  of  the  ith.  packet  in  the  jth  busy  period 

•  Tij  -  Time  instant  when  the  ith  transmission  slot  in  the  jth  busy  period  begins 

•  Kj  -  Time  instant  when  the  ith  vacation  slot  in  the  jth  busy  period  begins 

•  Vj  -  Number  of  vacation  slots  in  the  jth  busy  period. 

•  bj  -  Number  of  packets  in  the  jth  busy  period. 


6 


•  Pij  [7«i]  ■  Packet  index  of  the  first  [Zast]  packet  affected  by  the  removal  of  the  ith  vacation 
slot  in  the  jth  busy  period. 

Figure  2  illustrates  the  aforementioned  notation  where  vacation  slots  are  shown  darkened, 
arrivals  are  represented  by  arrows  above  the  horizontal  time  axis,  and  departures  by  arrows  below 
the  time  axis.  In  Figure  2,  phantomizing  (i.e.,  removal)  of  the  2nd  vacation  slot  from  the  mth 
busy  period  introduces  a  service  slot  between  the  1st  and  2nd  original  service  slots  and  causes  all 
remaining  customers  in  the  busy  period  to  begin  service  one  service  epoch  earher.  Thus,  the  first 
customer  affected  by  this  additional  service  slot  is  the  second  arrival  i.e.,  P2m  =  2.  On  the  other 
hand,  the  last  customer  to  be  affected  is  72m  =  3.  Finally,  as  a  consequence  of  the  phantom  slot, 
the  busy  period  in  the  nominal  sample  path  has  been  spht  into  two  busy  periods  in  the  perturbed 
sample  path. 

We  now  state  the  following  theorem  (the  proof  can  be  foimd  in  [7]): 

Theorem  1  An  unbiased  estimate  of  is  given  by: 

^1  =  _ I _ YY\v--T  • 

where 


/3ij  =  arg  max.  {m  : 

Tm,j  <  Vi,j}  +  1 

m  =  1, •  •  • 

,bj-l 

7i,-  =  ar5min{m 

TTl 

•  <  Tij} 

m  = 

and,  by  convention,  Abj+ij  = 

Observe  that  the  first  double  summation  (over  the  Vij  terms)  is  simply  the  sum  of  the  vacation 
slot  epochs,  and  in  addition  aU  remaining  quantities  aire  directly  measurable  from  the  sample  path. 
An  algorithm  for  implementing  an  estimator  based  on  Theorem  1  can  be  foimd  in  the  appendix  of 
[7].  From  an  implementation  viewpoint  memory /computational  overhead  is  minimized  by  noting 
that  the  majority  of  the  sample-path  quantities  (in  particular  Tij  and  Vij)  need  to  be  stored  only 
for  the  duration  of  a  busy  period. 

Finally,  note  that  an  estimator  based  on  the  dual  process  of  converting  a  transmission  slot  into 
a  vacation  slot  can  also  be  similarly  developed.  We  refer  to  transmission  slots  to  be  removed  from 
the  nominal  system  sample  path  as  marked  slots.  Although  marking  (i.e.,  converting  a  transmission 
slot  into  a  vacation  slot)  can  be  viewed  as  the  dual  process  of  phantomizing,  there  arise  some 
fundamental  differences  between  the  Phantom  Slot  and  Marked  Slot  estimator.  Most  notably,  in 
the  Phantom  Slot  estimator,  perturbational  effects  are  locahzed  to  the  busy  period  within  which 
they  originate;  as  a  result,  implementation  and  analysis  can  be  carried  out  for  every  busy  period  in 
isolation.  Alternatively,  in  the  Marked  Slot  estimator,  the  result  of  a  perturbation  due  to  marking 
a  service  slot  in  some  busy  period  can  propagate  to  subsequent  busy  periods  and  thus  busy  periods 
in  the  perturbed  sample  path  may  coalesce. 
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Figure  2a  -  Nominal  Sample  Path 
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Figure  2b  -  (2,m)  Phantom  Slot  Sample  Path 
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3  A  Schedule  Optimization  Algorithm 


Now  that  we  have  at  our  disposal  the  derivative  estimators  reqmred  for  solving  the  optimization 
problem  (P2),  we  may  proceed  to  develop  a  gradient-based  algorithm  for  obtaining  the  optimal 
schedule  (i.e.,  the  optimal  slot  assignment  probability  vector  0*  =  [^i,  •  ■  ■ ,  OmY  ^  system  with 
M  transmission  sets).  In  what  follows,  we  limit  ourselves  to  one  such  algorithm,  similar  to  one 
used  in  [17],  simply  to  illustrate  our  approach.  Looking  at  (4),  we  see  that  our  algorithm  is  such 
that  it  seeks  to  balance  sums  of  derivatives.  The  main  idea  in  our  algorithm  is  the  following:  at 
every  iteration,  find  the  maximum  imbalance  condition  and  adjust  the  variables  6i  so  as  to  reduce 
it. 

We  wiU  proceed  by  considering  two  examples,  one  for  the  simple  case  where  C  ,  and  one 
for  the  general  case  C  ^  A.  Finally,  it  should  be  clear  that  the  sample-path-based  nature  of  the 
derivative  estimators  on  which  our  optimization  approach  relies  possesses  some  inherent  “adaptive” 
properties  in  the  following  sense:  if  the  characteristics  of  Vcirious  arrival  processes  change,  then  the 
derivative  estimate  also  adjusts  itself  to  reflect  such  a  change  from  the  observed  data.  The  third 
example  in  this  section  is  intended  to  illustrate  these  adaptive  properties  by  allowing  the  topology 
of  a  system  to  change.  For  brevity  we  focus  on  the  problem  formulation  and  construction  of  the 
optimization  schemes;  simulation  resiilts  and  detailed  discussions  can  be  found  in  [7]. 

1.  A  Two-Node  RN  with  C  =  A.  Jxi  this  example,  we  consider  the  transmission 
scheduling  problem  with  two  arrival  streams  and  non-overlapping  transmission  sets.  Our  objective 
is  to  determine  the  optimal  slot  assignment  probabilities  so  as  to  minimize  the  mean  packet  waiting 
time.  For  this  simphfied  case,  the  optimization  problem  is  reduced  to  balancing  the  derivatives  of 
the  individual  packet  waiting  times.  Let  be  the  kth  observation  (iteration)  interval  over  which 
we  estimate  the  derivative  dWi/ddi  and  0^*’)  =  the  probabiflty  vector  over  this 

interval®.  At  the  end  of  the  fcth  interval  we  compare  individual  node  derivatives  Eind  set  i"  = 
argmin,[dWi/(i0i].  The  slot  assigiunent  probabilities  are  adjusted  so  as  to  increase  the  probability 
associated  with  i*  (and  hence  reduce  the  probability  associated  with  the  other  arrival  stream).  In 
this  simple  example,  we  need  only  control  a  single  probability.  In  particular,  consider  the  control 
of  6i ,  and  let  the  amount  of  chauge  for  the  fcth  interval  be  6k  where 


h 


dWi 


dW2 

def^ 


X  T)k 


and  77fc  is  a  “step  size”  parameter®.  At  the  end  of  the  A:th  observation  interval  we  update  the  node 
1  probability  as  follows: 


'  +  4 

'  e’f'^-6k 

. 


■f  ^ 

“  de-i 


> 


< 


d6i 


and 


M- 


oTE+i) 


<  1 


otherwise 


^When  C  =  A.  there  is  only  one  arrival  stream  in  each  transmission  set. 

^For  this  simple  netvsrork  9i  is  the  probability  that  a  transmission  slot  is  assigned  to  arrival  stream  i. 

®The  step  size  sequence  Tjk  must  be  properly  chosen  to  guarantee  convergence  [8].  Intuitively,  use  of  an  excessively 
small  step  size  will  result  in  slow  convergence,  whereas  use  of  an  excessively  large  step  size  can  result  in  oscillations 
and  thus  lack  of  convergence. 
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where  a  decrease  in  node  1  or  node  2  probability  is  permitted  if  and  only  if  at  the  new  operating 
point  we  do  not  violate  the  stability  requirement.  Finally,  we  assume  a  fixed  step  rik  =  0.001 

and  adjust  the  observation  interval  according  to  =  kLo  with  Lq  =  100  node  1  busy  periods.  The 
convergence  of  such  an  optimization  scheme  has  been  shown  in  [21]. 

2.  A  Four-Node  RN  with  C  ^  A.  Consider  the  4-node  RN  shown  in  Figure  la  where 
the  objective  is  to  minimize  the  average  packet  waiting  time  in  the  network.  As  was  discussed 
in  the  introduction,  we  can  translate  this  broadcast  scheduling  problem  into  a  poUing  model  with 
3  overlapping  transmission  sets.  Using  the  notation  introduced  in  section  2,  we  have  Zi  —  {!}, 
Z2  =  {1,  2},  Z^  =  {2, 3},  Zi,  =  {3}.  The  optimization  problem  can  be  formulated  as: 

4  3 

nun  ^/,(Ai)lFi(0)  s.i.  ^  =  1  (6) 

i=l  fc=l 

where  0  =  and  /i(A,)  is  the  fraction  of  arrivals  to  the  entire  network  that  arrive  at 

node  i  (typically  a  function  of  node  arrival  rate)^.  Introducing  the  new  variables  (pi,  i  =  1,  •  •  -  ,4, 
observe  from  the  specification  of  the  Zi  sets  that  =  ^i,  <^2  =  ^1  +  ^2,  <^3  =  ^2  +  ^3>  and  =  O^. 
Then,  based  on  these  variables  and  the  normalization  condition,  we  can  reformulate  the  problem 
as: 


t=l 

s.t.  +  ^3  =  1 

^2  +  <^4  =  1 


Using  Lagrangian  relaxation  and  eliminating  Lagrange  multiphers,  we  immediately  obtain  the 
following  necessary  conditions  for  am  optimal  point: 


(7) 

(8) 

The  optimization  problem  is  then  reduced  to  independently  balancing  two  pairs  of  derivatives. 
We  proceed  as  before  by  adopting  a  scheme  so  that  at  each  iteration  we  minimize  the  maximum 
difference  in  the  pairs  of  derivatives  involved.  Recall  that  the  minimization  is  over  the  slot  assign¬ 
ment  probabilities,  aind,  as  before,  let  0^^^  be  the  slot  assignment  probabihty  vector  over  the  kth 
observation  interval,  where  the  duration  of  the  latter  is  transmission  set  1  busy  periods.  Over 
this  interval  each  node  i  estimates  its  derivative  At  the  end  of  the  interval,  there  are  two 

cases: 


Case  1:  If 


t  5^1  _  f 
d4>\  d<t>3 


> 


f  _  f  dWt 

•'2  d<i>^ 


then  we  update  the  slot  assignment  proba- 


^To  simplify  notation,  we  omit  the  dependence  on  Ai  when  there  is  no  ambiguity. 
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bilities  as  follows: 


Q(fc+1)  _ 


e['"^  -  +  A'^  if  f/i^ 

eP  -  A'^- +  A’^  if  f/j! 

-  A'';  +  AV2;  if  f/r 

-  A^;  +  A'‘  if  (/i- 


^  /3 

^  f  §Ex 
^  fs  5i/)3 

/s  S^3 

^  dd>t 


A  —  /i  p ,  /a  o  j  ^ 

0(f>i  0(j>3 

where  Tjk  is  the  step  size  parameter.  To  ensure  convergence,  the  step  size  sequence  must  be  chosen 
to  satisfy  certain  standard  conditions  (e.g.,  [8]).  One  family  of  sequences  which  satisfies  these 
conditions  is 


Vk  = 


where  M  is  a  normahzation  constant  and  0  <P  <  1.  Finally,  note  that  in  (9)  only  components 
of  0  that  change  at  the  {k  +  l)th  iteration  are  explicitly  shown;  aU  remaining  components  are  the 
same  as  in  the  prior  iteration. 

Ca,.5;IfjA|^-/3®|  <  either,: 


0(*  +  l)  = 


-  A*' 

-  A'' 


^1''^  +  A*" 


e\  >  +  AV2:  ^  +  A*=/2  if 


if  ifi 


!f  iEi. 

■li  a,f,i 

r 

■'1  d(l>i 

f  £511 

■'1  5.^.1 

i  £551 

/i  erf>. 


^  /s  5,^3 

^  f  £B1 

^  j  3  a^3 


^  f  £21 
>  d(i>t 


and  (f2^  <  hi 


.  k  r  dWi  ,  dW^  1 

^  d<i>2  ~  ^  ^ 

Finally,  the  length  of  the  observation  interval  is  controlled  as  follows: 


where  Lq  is  an  a  priori  chosen  number  of  busy  periods.  The  aforementioned  optimization  procedure 
incorporates  both  step  size  as  well  as  sample  size  control®  [21].  Simulation  results  imder  asymmetric 
traffic  loads  can  be  found  in  [7]. 

®An  alternative  to  controlling  the  step  size  sequence  is  to  increase  the  estimation/observation  horizon  at  each 
iteration.  This  is  referred  to  as  “sample  size  control.”  The  convergence  of  such  a  scheme  has  been  formally  shown  in 
[2l].  An  informal  argument  is  as  follows:  If  the  estimators  are  consistent  (which  we  conjecture  to  be  the  case),  then 
as  the  observation  interval  Increases,  the  sample  derivative  converges  to  the  derivative  of  the  expected  waiting  time. 


11 


3.  Adaptivity  properties  when  topology  changes.  In  this  example,  we  illustrate  the 
adaptivity  of  our  algorithm  subject  to  a  change  in  the  topology  of  the  RN  considered  in  the  last 
example.  In  particular,  consider  once  again  the  4-node  RN  in  Figure  la  and  assume  that  a  new 
node  wishes  to  participate  in  the  transmission  process.  Moreover  the  “incoming”  node  (denoted 
as  node  5)  is  located  so  that  it  is  within  the  broadcast  zone  of  nodes  1  and  2,  i.e.,  node  5  is  a 
neighbor  of  both  nodes  1  and  2.  The  resultant  topology  is  shown  in  Figure  3a  by  the  inclusion  of 
the  dotted  Hnes.  The  effect  of  the  change  in  topology  is  to  alter  the  transmission  sets;  the  new 
transmission  sets  are  now  {(1,2),  (2,3),  (3,4,5)}  and  the  resultant  poUing  model  is  shown  in  Figure 
3b.  The  change  in  transmission  sets  gives  rise  to  modified  optimality  equations,  compared  to  the 
last  example.  In  particular,  the  new  Kuhn- Tucker  optimality  conditions  are: 


/i(Ai) 

fii^) 


dWi 

d(j)i 

dW2 


—  hi^z) 

—  14(^4) 


dWs 

d(j>z 

dWi 


+  fsi^s) 


dW. 


(12) 

(13) 


dh  ^  '  d<j>i  d(f>s 

A  similar  optimization  scheme  as  that  of  example  2  can  be  now  constructed  to  achieve  the  desired 
derivative  balance.  Again,  a  discussion  of  the  simtdation  results  can  be  found  in  [7]. 


4  A  Deterministic  Scheduling  Policy 


In  practice,  a  randomized  scheduling  pohcy  may  not  be  desirable  either  because  it  involves  a  random 
number  generation  process  or  because  it  may  be  required  that  the  time  between  successive  server 
visits  to  a  transmission  set  be  bounded  by  a  deterministic  constant.  In  this  section,  we  use  our 
approach  for  obtaining  optimal  slot  assignment  probabilities  in  conjimction  with  the  Golden  Ratio 
{GR)  pohcy  presented  in  [15]  to  identify  a  deterministic  scheduHng  pohcy  with  certain  optimahty 
properties.  Our  contribution  is  therefore  to  optimize  the  Golden  Ratio  policy.  We  then  provide 
simulation  results  aimed  at  comparing  this  pohcy  to  several  others,  including  our  random  polling 
approach  developed  in  the  previous  sections.  Note  that  in  specifying  a  deterministic  pohcy,  we  are 
seeking  the  specification  of  a  scheduhng  frame:  a  frame  consists  of  a  fixed  number  F  of  time  slots 
with  each  slot  aUocated  to  a  given  transmission  set.  The  frame  repeats  itself  in  time,  thus  defining 
a  periodic  structure  through  which  the  server  is  assigned  to  each  transmission  set.  The  number  F 
of  slots  in  the  frame  is  chosen  according  to  a  desired  upper  bound  on  transmission  set  intervisit 
times.  The  problem  we  address  here  is  how  to  ahocate  the  F  slots  to  the  M  transmission  sets. 


The  Golden  Ratio  Scheduling  Policy.  Let  us  briefly  summarize  this  pohcy  as  presented 
in  [15].  As  before  consider  M  transmission  sets  and  let  6i  be  the  desirable  fraction  of  slots  to  be 
assigned  to  transmission  set  i.  Let  Fk 

(\/(5)  -  l)/2  %  0.618034.  Then,  let  AjJ,  z  =  1,  •  •  •,  M  be  integers  such  that: 


Fibonacci  number,  where  p  ^ 


with  =  0.  Thus 


M 

<  Ni  <  and  ^ 

i=l 


k—*oo  rf^ 


(14) 
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^3  Xj  X4  X2 


node  3  node  1  node  4  node  2 

Figure  3a:  RN  Subject  to  a  Topology  Change 


Switching  is  synchronized 
with  slot  allocation 


Figure  3b:  Modified  Multiclass  Polling  System 
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For  each  k  the  GR  pohcy  assigns  Nj^  slots  to  transmission  set  i  and  attempts  to  distribute  the 
allocation  of  slots  uniformly  over  a  frame  of  size  Fk-  Note  that  although  in  the  hmit  k  oo  visits 
to  transmission  set  i  axe  equally  spaced,  because  of  the  generally  overlapping  transmission  set,  visits 
to  a  particular  node  need  not  be  equally  spaced. 

Let  frac{x)  =  x  —  [x\,  aj  =  frac{j(p~^)  and  Ap^  =  {aj\j  =  0,---,Ffc  -  1},  where  the 
nth  (1  <  n  <  Ffc)  smallest  element  of  Ap^^  is  associated  with  the  nth  slot  in  the  frame.  The  final 
step  in  the  GR  policy  is  then  one  which  assigns  to  class  i  the  following  slots  within  a  frame: 


E  <  y  <  E 


m=l 


m=l 


(15) 


Note  that  k  determines  the  desired  length  of  the  scheduling  frame,  which  we  assume  is  given.  Our 
task  is  to  specify  the  optimal  6i,  i  =  !,■■  -^M.  Once  this  is  done,  one  can  use  (14)  and  (15)  to 
allocate  slots  in  the  frame.  Finally,  observe  that  if  all  6i  are  equal  then  GR  reverts  to  the  simple 
Roimd  Robin  pohcy  discussed  next.  We  ihustrate  the  construction  of  the  GR  pohcy  through  the 
foUowing  example. 

Example:  To  ihustrate  the  procedure  consider  the  GR  pohcy  corresponding  to  the  optimal 
slot  ahocation  probabihties  6\  =  0.32;  02  =  0.18  and  6^  =  0.50  .  Let  fc  =  7  so  that  we  define  a 
frame  of  length  F^  =  13,  and,  using  these  values  of  0i,  62,  O3  in  (14),  we  get  N7  =  4,  N7  =  3 
and  =  6.  From  (15)  the  slots  corresponding  to  {0,  frac(2(p~^),  frac{Zy>~^)}  are  assigned  to 

class  1;  the  slots  corresponding  to  {frac{4(p~^),-  ■  •,  frac{6ip~^)}  are  assigned  to  class  2  and,  lastly, 
the  slots  corresponding  to  {frac{7tp~^),  •  •  •,  frac{12(p~^)}  are  assigned  to  class  3.  Consequently  we 
can  write  A13  =  {0,  (p~^ ,  frac{2tp~^),  •  •  • ,  frac{12(p~^)} .  Evaluating  the  individual  terms  in  ^13  and 
rearranging  then  in  an  increasing  order  (recalhng  that  the  nth  smahest  element  corresponds  to  the 
nth  slot)  we  obtain  the  foUowing  polhng  sequence:  1— >2— >3— >1— >3— >3— >2— »3— >1— >2— > 
3  ^  1  ^  3. 

The  Round  Robin  Policy  In  the  Roimd  Robin  (RR)  pohcy,  assuming  M  transmission 
sets,  slots  are  assigned  to  each  transmission  set  according  to  the  foUowing  simple  sequence:  1  — > 
2—*...—>M—^l—^2—>---^M---.  If  we  define  a  frame  of  length  M  slots,  then  RR 
assigns  each  transmission  set  exactly  1  slot  in  every  M  slots.  RR  scheduhng  pohcies  in  the  context 
of  polhng  system  have  been  weU  researched  and  have  been  shown  to  be  optimal  (over  the  class 
of  ah  admissible  pohcies)  for  systems  with  symmetric  traffic  and  non-overlapping  transmission 
sets  [22,  15].  We  conjecture  a  similar  result  for  overlapping  transnaission  sets.  In  particular  the 
superiority  of  RR  over  random  polhng,  under  symmetric  traffic,  can  be  attributed  to  the  higher 
variance  of  the  intervisit  time  (time,  in  slots,  between  successive  visits  to  a  transmission  set)  in 
random  poUing.  However  as  we  deviate  from  symmetric  traffic  conditions,  RR  rapidly  deteriorates 
in  performance,  whereas  random  polhng  is  fairly  ‘robust.’  The  last  observation  is  true  since  random 
polhng  wiU  adapt  to  the  changing  traffic  and  aUocate  slots  to  reflect  the  change.  The  optimized 
GR  pohcy  may  be  thought  of  as  an  effort  to  combine  the  variance  properties  of  the  frame  structure 
with  the  adaptive  nature  of  random  polhng  in  order  to  design  a  frame  which  reflects  the  optimal 
slot  ahocation  probabihties. 

The  Maximal  Traffic  Scheduling  Policy  The  Maximal  Traffic  Scheduling  Policy  [MTP) 
is  a  variant  to  the  optimal  GR  pohcy  where,  rather  than  using  the  optimal  0i’s  to  construct  the 
frame,  we  construct  a  frame  such  that  the  frequency  of  visits  to  a  particular  transmission  set  is 
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a  reflection  of  the  ‘maximal  traffic’  at  that  transmission  set.  Equivalently  MTP  assigns  priorities 
based  on  the  maximum  arrival  rate  to  a  transmission  set.  For  example,  if  in  Figure  lb  we  let  the 
arrival  rates  be  Ai  =  0.1,  A2  =  0.2,  A3  =  0.3,  A4  0.2,  then  the  maximal  traffic  at  transmission 
set  1  is  max(Ai,A2)  =  0.2;  similarly  for  transmission  sets  2  and  3  the  maximal  traffic  is  0.3. 
Consequently  the  desirable  fraction  of  slots  to  be  assigned  to  transmission  sets  1,2  and  3  is  |,| 
and  I  respectively.  Using  the  same  procedure  as  for  the  GR  (see  (15))  the  MTP  polling  sequence 
is:  l-^3->2^3-^2-4l-.3-2. 

MTP  is  an  inherently  conservative  policy  in  that  it  ignores  the  overlapping  structure  and 
allocates  slots  assuming  that  if  an  arrival  stream  belongs  to  a  particular  transmission  set,  then 
all  packets  from  that  stream  are  served  in  that  transmission  set.  The  efficiency  of  MTP  is  con¬ 
tingent  on  the  arrival  rates  of  overlapping  arrival  streams  (streams  that  belong  to  more  than  one 
transmission  set).  For  example,  if  the  maximal  arrival  rate  in  each  transmission  set  corresponds 
to  a  non-overlapping  stream,  then  MTP  incurs  no  penalty  by  ignoring  the  overlapping  structure. 
Alternatively,  if  the  maximal  rate  corresponds  to  an  overlapping  stream,  then  MTP  assigns  surplus 
slots  to  that  transmission  set  at  the  expense  of  increasing  the  mean  intervisit  time  for  streams  not 
belonging  to  that  set.  Finally,  if  the  maximal  arrival  rate  is  the  same  for  each  transmission  set  then 
MTP  reverts  to  RR. 

A  comparison  of  random  polling  (as  developed  in  previous  sections),  RR,  optimal  GR  (where 
the  optimization  is  based  on  the  slot  assigmnent  probability  vector  0*  determined  through  our  ap¬ 
proach),  and  MTP  is  presented  in  [7]  for  various  system  parameter  (surrival  rates  and  distributions). 
The  conclusion  drawn  is  that  in  each  case  GR  performs  better  than  RR  or  random  polling;  however 
random  polling,  even  under  optimal  slot  assignments,  does  not  always  perform  better  than  RR. 
The  last  observation  is  attributed  to  the  higher  variance  of  the  intervisit  time  in  random  polling. 

5  Scheduling  in  Networks  with  Voice  Traffic 

For  the  remainder  of  the  report  we  focus  on  scheduling  voice  calls  in  an  A-node  network  with  (for 
simplicity)  N  non-overlapping  (distinct)  trcinsmission  sets.  The  Einalysis  readily  extends  to  the  case 
with  overlapping  transmission  sets.  In  this  model,  ‘transmission  set’  is  synonymous  with  ‘node’ 
and  thus,  for  brevity,  the  latter  terminology  is  adopted.  Recall  that  voice  traffic  is  delay-sensitive 
traffic  in  the  following  sense:  voice  packets  caimot  be  queued  for  more  than  n  time  slots,  where  n 
is  fixed.  Thus,  upon  arrival,  a  voice  caU  is  accepted  if  it  can  be  assigned  a  transmission  slot  within 
the  call  setup  time^  otherwise  it  is  blocked.  Once  a  call  is  accepted,  then  due  to  the  cyclic  nature  of 
the  polling  policy,  we  can  guarantee  that  packets  belonging  to  this  call  are  assigned  a  transmission 
slot  every  n  time  slots.  We  consider  a  cyclic  policy,  where  the  polling  cycle  is  specified  by  a  frame 
comprised  of  n  slots,  such  that  a  slot  is  uniquely  assigned  to  a  particular  transmission  set.  Thus,  a 
frame  is  characterized  by  a  vector  [cj ,  •  •  • ,  c„]  where  Ci  £  {1,  •  •  ■ ,  A}  is  the  transmission  set  (node) 
assigned  to  slot  i.  Our  objective  then  is  to  determine  the  optimal  frame  that  minimizes  the  average 
caU  blocking  probability. 

The  delay-sensitive  blocking  model  can  be  used  to  model  voice  call  processing  in  an  A-node 
multihop  RN  [10,  24].  When  processing  voice  traffic  with  circuit  switching,  a  voice  call  arriving 

°In  this  report  the  call  setup  time  is  defined  as  the  maximum  duration  a  call  can  be  queued  before  a  decision  to 
accept/reject  the  call  is  made. 
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at  a  node  reserves  (for  the  duration  of  the  voice  call)  the  desired  bandwidth  at  each  node  along  a 
multihop  path.  If,  upon  arrival  of  a  voice  call,  bcindwidth  is  unavailable  at  any  of  the  intermediate 
nodes  required,  the  call  is  blocked.  This  is  also  referred  to  as  ‘voice  admission  control’,  a  problem 
also  considered  in  [l]  using  a  model  not  based  on  slotted  time,  but  rather  frequency  division 
multiplexing  to  overcome  the  problem  of  chaimel  access  conflicts.  In  the  context  of  our  slotted-time 
model.  Time  Division  Multiplexing  (TDM)  is  employed  to  provide  contention-free  multiplexing  of 
the  bandwidth.  Moreover,  the  duration  of  a  time  slot  is  determined  by  the  bandwidth  reqiurement 
of  each  node  (for  simplicity,  we  assume  that  the  bandwidth  requirements  are  the  same  at  all  nodes). 

In  the  general  TDM  framework,  a  frame  consisting  of  n  time  slots  is  deflned  so  that  each  slot 
is  assigned  to  a  voice  call  (or  several  voice  calls  belonging  to  the  same  transmission  set).  The  size 
of  the  frame  (i.e.,  the  number  of  slots  n)  is  chosen  so  that  proper  voice  transmission  is  ensured. 
The  frame  is  repeated  in  time  so  that  the  controller  assigns  the  server  to  each  transmission  set  in 
accordance  with  the  frame  structure.  Thus,  a  call  is  blocked  if  it  cannot  be  assigned  a  slot  in  the 
TDM  frame.  The  design  of  the  frame  then  represents  a  means  of  controlling  the  performance  of  the 
system  in  terms  of  the  blocking  probability  of  calls.  In  the  remainder  of  this  section  we  describe 
the  call  arrival  process  in  more  detail,  and  deflne  two  modes  of  delay-sensitive  operation,  termed 
slot  delay  blocking  and  frame  delay  blocking. 

We  refrain  from  providing  a  specific  model  for  voice;  rather,  we  assume  that  sampling  and 
encoding  are  such  that  at  most  one  packet  is  submitted  for  transmission  per  frame  by  ciny  individual 
call.  This  guarantees  that  if  a  call  is  accepted,  then  no  packet  from  that  call  wiU  be  queued  for 
service.  We  can  now  describe  our  model  as  follows.  At  each  node  i,  i  =  1, ...,  A,  there  is  a  process 
characterizing  voice  call  arrivals.  We  assume  an  arbitrary  interarrival  distribution  for  calls,  and 
allow  for  correlations  between  call  arrivals.  The  jth  call  at  node  i  is  characterized  by  the  pair 
(A‘-,77)),  where  A)  is  the  call  arrival  epoch  and  rij  is  the  call  duration,  specified  as  a  number  of 
frames.  The  discrete  random  variable  7/)  has  an  arbitrary  distribution.  Equivalently  7/)  can  be 
viewed  as  the  number  of  packets  in  the  jth  node  i  call.  Note  that  A*-  and  7;)  do  not  have  be  known 
apriori.  The  decision  to  accept  or  reject  a  call  is  made  independent  of  the  call  duration,  and 
moreover,  once  the  call  is  accepted,  it  is  guaranteed  one  slot  per  frame  for  the  duration  of  the  call. 

Next,  we  describe  the  operation  of  the  system  from  node  i’s  point  of  view;  the  operation  is 
the  same  from  the  point  of  view  of  any  other  node.  The  server  is  assigned  to  nodes  based  on  a  frame 
consisting  of  n  slots  (as  already  mentioned,  n  depends  on  the  characteristics  of  the  delay-sensitive 
traffic  we  are  serving).  Each  slot  is  assigned  to  some  node.  Thus,  from  node  i ’s  perspective,  the 
frame  consists  of  slots  assigned  to  i  {transmission  slots)  and  slots  assigned  to  some  other  node 
[vacation  slots).  Suppose  a  frame  is  such  that  ni  slots  are  assigned  to  node  i.  For  any  time  instant, 
let  fi,  0  <  fi  <  ni,  he  the  number  of  transmission  slots  not  committed  to  any  ongoing  node  i  Ccill. 
Then,  when  a  call  (A),  77))  is  submitted  to  the  system,  the  call  is  admitted  if  /,•  >  0,  in  which  case  /,■ 
is  decremented  by  1;  otherwise,  the  call  is  blocked  and  considered  lost.  Moreover,  this  call  reserves 
the  slot  it  is  assigned  for  the  next  77)  frames,  i.e.,  if  the  jth  call  is  accepted  and  begins  using  the  kth 
slot  of  the  mth  frame  on  the  time  line,  then  it  reserves  the  kth  slot  for  the  {(tti-)-!),  •  •  • ,  (771-1-77)  —  1)} 
frames.  These  slots  are  now  considered  unavailable  to  future  voice  calls  arriving  at  i. 

The  model  is  complete  once  we  specify  the  call  setup  time,  i.e.,  how  long  an  arriving  call 
can  wait  for  an  accept/reject  decision.  We  consider  two  variants  on  the  call  setup  time.  In  the 
first  variant,  henceforth  referred  to  as  Slot  Delay  (SD)  blocking,  an  arriving  call  is  queued  until  the 
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beginning  of  the  next  slot  (vacation  or  transmission)  only,  resulting  in  a  call  set  up  of  one  time 
slot.  A  call  is  therefore  blocked  if  within  one  slot  duration  of  the  call  arrival  epoch  an  available 
transmission  slot  is  not  assigned  to  node  i  (recall  that  a  transmission  slot  is  deemed  available  if 
it  has  not  been  reserved  by  any  prior  voice  call).  This  is  true  regardless  of  whether  there  are  any 
transmission  slots  actually  available  in  the  frame.  If  the  call  is  accepted,  it  proceeds  to  reserve  slots 
in  subsequent  frames  as  described  in  the  preceding  paragraph. 

Alternatively,  in  Frame  Delay  (FD)  blocking,  the  decision  to  accept  calls  is  made  at  the 
beginning  of  each  frame  (for  a  maximum  call  setup  of  2n  —  1  slot  durations^®);  all  calls  that  arrive 
during  a  frame  are  therefore  queued  up  to  the  beginning  of  the  next  frame.  At  that  time,  those 
calls  that  cannot  be  assigned  an  available  transmission  slot  sire  blocked.  As  before,  if  call  (A‘-,t;)) 
is  accepted,  it  reserves  the  slot  it  is  assigned  for  t;*-  frames.  Note  that  this  model  allows  for  an 
arbitrary  selection  of  which  calls  at  the  begirming  of  any  frame  will  be  blocked,  whereas  in  SD 
queuing  the  First- In- First- Out  property  is  always  preserved.  It  is  also  worth  pointing  out  that,  in 
FD  blocking,  if  there  are  fi  >  Q  available  transmission  slots  when  a  call  arrives,  the  precise  slot 
identity  in  the  frame  which  is  assigned  to  this  caU  does  not  affect  the  performance  of  the  system 
in  terms  of  future  blocked  calls. 

6  Discrete  Optimization  Problem  Formulation 

We  now  formulate  the  scheduling  problem  as  an  optimal  slot  allocation  problem.  Let  Cj  denote  the 
node  assigned  to  slot  j  in  a  frame  consisting  of  n  slots.  Then,  let  S  be  the  finite  set  of  feasible 
frames  where: 

5  =  {[ci,---,c„]  :  Cj  £ 

By  “feasible”  we  mean  that  the  frame  must  be  chosen  to  satisfy  some  basic  requirements,  such  as 
that  at  least  one  slot  is  assigned  to  each  node.  For  any  s  £  S,  let  Ji{s)  =  £^[Li(s)]  be  the  node  i 
cost  function,  where  as  before  L,(s)  is  the  sample  node  i  cost.  Then,  our  objective  is  to  select  s 
G  5  so  as  to  solve  the  following  discrete  optimization  problem: 

Problem  P3: 

where  /3,-  is  the  weight  associated  with  node  i.  This  is  generally  a  difficult  problem,  as  it  involves 
both  optimization  over  a  discrete  set  and  estimation  of  the  total  cost  under  aU  possible  frames  s  £  S. 
Rather  than  attempting  to  solve  it,  we  transform  (P3)  into  a  continuous  parameter  optimization 
problem  as  follows. 

6.1  Transforming  the  Discrete  Optimization  Problem  into  a  Continuous  Opti¬ 
mization  Problem 

Let  6i  =  P[cj  =  i],  independent  of  the  slot  index  j  =  l,...,n.  We  can  then  construct  a  frame 
through  a  randomization  mechanism  based  on  a  probabihty  vector  6  =  [6i, ...,  0;v],  with  — 

*®The  maximum  call  setup  corresponds  to  a  voice  call  that  arrives  just  after  the  beginning  of  a  frame  and  is  assigned 
the  last  time  slot  in  the  subsequent  frame. 
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1,  whereby  each  slot  is  independently  assigned  to  node  i  with  probabihty  6i.  In  this  setting,  6 
represents  the  control  parameter  which  can  be  optimally  selected  so  as  to  minimize  the  desired  cost 
function.  In  particular,  we  replace  problem  (P3)  by  the  following  constrained  continuous  parameter 
optimization  problem: 

Problem  P4: 


N  N 

^^Y^l3iE[Li{0)]  s.t.  Y^ei  =  i 
1=1  i=l 

The  relationship  between  the  slot  assignment  probabihty  vector  6  and  the  actual  frcime  s  can  be 
made  precise  as  follows.  Let  r  =  [ri,  •  •  • ,  rj  be  an  n-dimensional  vector  of  independently  generated 
random  numbers  with  every  rj  uniformly  distributed  in  [0,1].  A  frame  s(0,r)  =  [ci,---,c„]  is 
obtained  using  the  standard  inverse  transform  technique  for  generating  random  variates  Ci,  ...,c„ 
as  follows  [16]: 

t 

Cj  —  Tnin{i  :  rj  <  ^  6^,  i  =  1,  •  •  • ,  N}  (16) 

k=l 

It  is  then  clear  that,  for  a  given  r,  by  adjusting  the  parameters  di,  i  =  1, ...,  A,  we  can  affect  Cj, 
j  =  l,...,n,  and,  consequently,  control  the  design  of  the  frame.  Prom  a  notational  standpoint,  it 
wiU  be  useful  to  distinguish  between  a  frame  generated  through  (16),  which  is  denoted  by  s(0,r), 
and  a  frame  denoted  by  s,  which  is  simply  an  element  of  the  set  S. 

The  obvious  advantage  of  replacing  the  discrete  optimization  problem  (P3)  by  the  continuous 
optimization  problem  (P4)  is  the  fact  that  the  latter  may  be  solved  through  standard  nonhnear 
programming  techniques  (e.g.,  using  a  Lagrangian  relaxation  approach).  Moreover,  if  closed-form 
expressions  for  J,(-)  are  available,  (P2)  is  reduced  to  solving  a  system  of  algebraic  equations.  If, 
on  the  other  hand,  such  expressions  are  not  available,  then  we  can  still  resort  to  standard  gradient- 
based  optimization  algorithms  (hill-chmbing  or  steepest  descent).  Thus  we  need  to  derive  estimators 
similar  to  those  developed  in  [7]  and  in  section  2. 

Since  our  goal  then  is  to  estimate  dE[Li{d)]/d0i  from  a  single  sample  path,  we  need  to 
generate  a  sample  path  of  RN  operation  in  a  stochastic  environment.  To  do  so,  we  need  to  specify 
a  frame  s(0,  r).  Assuming  that  a  control  vector  0  is  specified,  then  a  sample  path  is  characterized  by 
the  vector  r  and  we  write  in  (P4)  E[Li{0)]  =  PJ[L,(s(^,  r))].  Consequently, we  see  that  the  solution 
of  (P4)  is  dependent  on  the  initial  selection  of  r,  which  is  subsequently  held  fixed  throughout  the 
optimization  procediue.  If  we  repeat  the  process  with  a  new  initial  r,  then,  in  general,  a  different 
optimed point  0*  is  attained.  A  solution  to  (P4)  is  therefore  characterized  by  the  pair  {0k^^k)  where 
the  subscript  refers  to  the  fcth  optimization  run.  However,  we  claim  that,  the  frame  s(0^,rfc)  is 
fixed  for  all  k,  and,  under  certain  conditions,  it  is  also  the  solution  to  (P3). 

In  the  next  section  we  adopt  the  Marked  Slot  methodology  proposed  in  [4]  in  order  to  obtain 
an  unbiased  estimate  of  for  any  node  i  —  1,...,A.  Note  that  /{(•)  is  a  function  of  0i  only, 
i.e.,  the  fraction  of  calls  blocked  at  node  i  depends  only  on  the  fraction  of  slots  assigned  to  i.  We 
can  therefore  concentrate  on  an  isolated  node  i.  Recall  that  a  frame,  from  node  z’s  perspective,  is 
comprised  of  transmission  and  vacation  slots;  therefore  a  frame  s  =  [ci,  ...,c„]  can  be  represented 
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by  the  sequence  where  the  Boolean  variable  uj  is  given  by 


1  if  the  jth  slot  in  frame  s  is  a  transmission  slot  for  node  i 
0  otherwise 


For  some  given  6  and  r  we  can  construct  s  through  the  following: 

^  I  0  otherwise 


(17) 


where  Cj  is  given  by  (16).  Alternatively,  since  from  node  i’s  point  of  view  slot  j  in  the  frame  is  a 
transmission  slot  with  probabihty  6i  and  a  vacation  slot  with  probabihty  (1  —  0i),  we  have 


Uj 


1  if  Tj  <  6i 
0  otherwise 


(18) 


where  r'  =  [r(,-  ■  -  is  a  vector  of  independently  generated  random  numbers,  each  uniformly 
distributed  in  [0,1],  which  can  be  obtained  from  the  original  vector  r  through  a  simple  hnear 
transformation. 


7  Derivative  Estimation  through  the  Marked  Slot  Approach 

In  this  section  we  use  the  concept  of  marking  (as  defined  earlier;  see  section  2)  transmission  slots  in 
order  to  obtain  rmbiased  derivative  estimates  based  on  observation  of  a  single  sample  path  of  our 
system.  The  fimdamental  difference  between  making  a  slot  in  a  purely  random  pohcy  as  opposed 
to  a  frame-based  one  is  that  in  the  latter  the  marking  of  a  slot  in  a  given  frame  also  results  in  the 

marking  of  the  same  slot  in  every  subsequent  frame.  We  refer  to  the  j -marked  slot  system  as  the 

sample  path  generated  when  the  jth.  transmission  slot  in  the  nominal  frame  is  marked.  Let  us  now 
concentrate  on  the  specific  performance  measure  of  interest  to  our  problem,  i.e.,  let  Ji{0i)  be  the 
expected  fraction  of  calls  blocked  at  node  i  after  K  call  arrivals,  which  we  will  denote  by  Pi.  Define 
the  following  sample  path  quantities  for  each  node  i: 

•  [^i(7  )]  ■  Total  number  of  blocked  calls  at  node  i  in  the  nominal  [j -marked  slot]  system 

•  Q,(j)  -  Total  number  of  node  i  calls  accepted  in  the  jth  transmission  slot  of  any  frame. 

•  ai{k)  -  Number  of  call  arrivals  at  node  i  during  the  kth  fraime 

•  di{k)  -  Nximber  of  call  completions  at  node  i  during  the  kth  frame 

•  fi{k)  -  Number  of  transmission  slots  available  to  node  i  in  the  kth  frame  (i.e.,  slots  assigned 
to  i  which  are  not  currently  used  by  a  node  i  call) 

Then,  we  consider  the  sample  function  L{6i,u>)  —  bifK,  with  Pi  —  E[bi]/K.  Note  that  we  limit 
oiurselves  here  to  sample  paths  defined  by  K  call  arrivals  at  node  i.  Under  standard  ergodicity 
conditions,  we  expect  that  as  A  — >  oo,  L  converges  a.s.  to  the  steady-state  blocking  probability  at 
node  i.  With  the  notation  defined  above  we  have  the  following  theorem  (the  proof  can  be  found  in 

[5]): 
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Theorem  2  An  unbiased  estimate  of  ^ 


is  given  by: 


l>i| 


\dPi 


(19) 


In  summary,  (19)  requires  us  to  calculate  the  change  in  performance  when  the  jth  (for  all  j  G  A) 
transmission  slot  is  marked  in  the  nominal  frame.  In  the  remainder  of  this  section  we  present 
expressions  for  evaluating  this  change,  in  terms  of  quantities  directly  observable  on  the  nominal 
sample  path,  first  operating  under  SD  blocking  and  then  FD  blocking.  Again,  for  brevity,  we  will 
present  only  the  final  result  and  omit  the  actual  derivation. 


7.1  Derivative  Estimation  with  Slot  Delay  Blocking 

Recall,  that  the  effect  of  marking  the  jth  slot  in  the  first  frame  is  to  mark  the  jth  slot  in  every 
subsequent  frame.  The  consequences  of  such  a  coupled  marking  is  that  aU  calls  that  were  originally 
accepted  in  the  jth  transmission  slot  of  any  frcime  in  the  nominal  system,  will  now  be  blocked 
in  the  j-marked  system.  Therefore,  the  change  in  number  of  node  i  blocked  calls  when  the  jth 
transmission  slot  is  marked  is  given  by  a,(j)  or  the  total  number  of  node  i  calls  accepted  in  the  jth 
transmission  slot  of  any  frame.  Thus  we  have  the  following  result: 

Theorem  3  An  unbiased  estimate  of  ^  is  given  by: 


dPi 


[dOi 


eit 


bj/K  -  1 

Bi 


(20) 


The  proof  can  be  found  in  [5]. 

Note  that  since  the  estimator  in  (20)  is  imbiased,  it  follows  that 


dPi 


=  E 


bi/K  -  1 


Oi 


Pj-l 

Oi 


(21) 


The  first-order  differential  equation  in  (21)  can  be  solved  to  obtain  the  linear  equation  for  P^: 


Pi  =  mei  +  l  (22) 

where  m  is  the  slope,  an  imbiased  estimate  of  which  is  given  by  (20).  The  ramification  of  this 
result  is  that  (P4)  is  now  transformed  into  a  linear  programing  problem  and  can  be  eflaciently 
solved.  It  is  interesting  to  note  that  this  result  is  easily  derived  through  the  “perturbation-like” 
argument  given  above,  which  is  completely  independent  of  the  caU  arrival  process  or  the  distribution 
characterizing  call  durations.  It  is  an  example  of  a  simple  sample-path-type  argument  that  can  be 
used  not  to  derive  explicit  derivative  estimates,  but  to  establish  a  functional  relationship  between 
a  performance  metric.  Pi,  and  a  parameter  of  interest,  9i. 
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7.2  Derivative  Estimation  with  Frame  Delay  Blocking 

The  primary  difference  between  slot  marking  with  SD  and  FD  blocking  is  that,  in  the  latter, 
marking  a  transmission  slot  does  not  necessarily  imply  that  a  call,  if  accepted  in  the  marked  slot, 
wiU  be  blocked  in  the  perturbed  system.  Define  a  “iaggecP’  call  to  be  a  call  that  is  accepted  in 
the  nominal  but  not  in  some  ji-marked  sample  path.  Then,  by  definition,  A6,(j)  is  given  by  the 
total  number  of  tagged  calls  over  the  observation  interval.  Therefore  if  we  can  monitor  the  tagging 
process  then  we  can  derive  the  appropriate  estimator.  Before  proceeding  further  we  define 

K 

n,- =  ^  l[sj  =  t] 
i=i 

where  l(-)  is  the  standard  indicator  function.  Thus,  is  simply  the  number  of  slots  allocated  to 
node  i  in  some  frame  s.  We  shall  now  make  the  following  simphfying  assumption  for  our  problem: 

•  Al:  Li{s)  depends  only  on  the  number  of  slots  assigned  to  node  i,  i.e.,  Li{s)  =  l/,(n,). 

Clearly,  Al  is  justified  when  the  sample  function  is  the  blocking  probability  under  FD  blocking. 
However,  the  assumption  would  not  hold  in  cases  where  the  identity  of  the  slots  assigned  to  node 
i  affects  that  node’s  cost  function.  For  example,  if  the  sample  function  were  the  individual  node 
mean  waiting  time,  then  clearly  the  latter  is  a  function  of  the  position  of  the  transmission  slots 
within  the  frame,  and  not  just  of  the  number  of  such  transmission  slots.  Lastly,  note  that  as  a 
consequence  of  there  can  be  at  most  one  tagged  call  in  the  nominal  system  at  any  instant. 

To  formalize  the  process  of  call  tagging,  we  define  the  binairy  variable  Zi{k),  where  we  use 
Zi{k)  =  1  to  denote  the  fact  that  there  is  a  tagged  call  at  the  beginning  of  the  l:th  frame.  The 
dynamics  of  the  tagging  process  are  then  given  by: 

1  if  [a, -(A:)  >  fi{k)  +  di(A:)]  and 

[{zi[k)  =  0)  or  (tagged  cedi  depeu’ts  in  frame  k)] 

0  if  (tagged  call  departs  in  frame  k)  and  [a,(fc)  <  fi{k)  +  di{k)] 

Zi[k)  otherwise 

with  initial  condition  z,(l)  =  0.  We  claim  that  (for  details  see  [5]): 

Theorem  4  An  unbiased  estimate  of  ^  is  given  by: 

-\A\  -A 

=  l[a,(A:)  >  fi{k)  +  di(fc)ll  i(z,(t)  =  0)  or  (tagged  call  departs)] 

k=i 

where  F  is  the  number  of  frames  contained  in  a  sample  path  defined  by  K  call  arrivals  at  node  i. 

Finally,  a  reduced-variance  estimator  can  be  obtained  by  exploiting  the  fact  that  6i  =  E\A\/n. 
Thus,  the  estimator  we  finally  use  (which,  in  general,  will  no  longer  be  unbiased)  is 

F 

~  Y]  l[a, (A:)  > /i(fc) -1- di(A;)]l  [(z.(l:)  =  0)  or  (tagged  call  departs)]  (23) 

L  ddi  K 

For  the  remainder  of  the  report  we  focus  on  the  optimization  problem  assuming  FD  blocking. 


Zi{k  -1-1)  = 
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8  Convergence  to  a  Global  Optimum 


Before  presenting  our  main  result,  let  us  summcLrize  our  approach  by  means  of  the  following  opti¬ 
mization  scheme  (SI).  For  brevity,  we  denote  the  estimate  in  (23)  by  Di. 

1.  Initially  select  some  r  and  Hence,  determine  an  initial  frame  =  s(0(°),r)  through 
(16). 

2.  Observe  a  sample  path  imder  r)  and  estimate  the  derivatives  for  all  i  =  1,  •  -  • , 

3.  For  any  m  =  0, 1,  •  •  •,  iterate  as  f  illdws 

+  ^  (24) 

k=\ 

with  some  provisions  to  ensure  that  =  1  for  aU  m  =  0, 1,  •  • 

4.  Observe  a  sample  path  imder  r)  to  estimate  the  derivatives  for  all  t  ==  1,  •  •  ■ , 

and  repeat  step  3  until  we  satisfy  stopping  condition. 

Of  course,  (24)  is  a  standard  stochastic  approximation  scheme  driven  by  the  derivative  esti¬ 
mates  DJ"  with  {tjm}  an  appropriately  selected  step  size  sequence.  There  are  several  important 
observations:  first  after  an  update  in  the  auxiliary  vector  the  frame  is  also  updated  using 

the  transformation  defined  in  (16).  Second,  the  iterative  scheme  is  terminated  when  we  reach  a 
stopping  condition,  and  not  necessarily  when  6^’s  have  converged.  In  particular,  the  stopping 
condition  is  defined  as  one  where 

max{£),-”*\  i  =  1,  •  •  • ,  N} 

is  minimized  over  the  iteration  index  m.  Finally,  note  that  r  remains  fixed  throughout  the  process. 
For  more  details  on  the  algorithm  the  reader  is  referred  to  [6]. 

In  addition,  we  make  the  following  assumption  regarding  the  cost  functions  of  interest: 

•  A2:  For  all  z  =  1,  •■,  N,  Li{ni)  is  such  that  Li{ni  -I  1)  -  Li{ni)  >  Li{ni)  -  Li{ni  -  1). 

We  can  now  establish  the  following  result.  Let  us  first  consider  a  specific  sample  path  and  apply 
the  optimization  scheme  (Si).  Let  6‘  be  the  probabibty  vector  when  the  stopping  condition  is  met 
in  (24),  and  let  s(0*,r)  be  the  corresponding  frame.  This  frame  is  an  optimal  one  in  the  discrete 
space  S,  i.e.,  s(0®,r)  =  s',  where  s'  is  independent  of  r  and  of  the  sequence  m  =  0,1,--- 

which  leads  to  the  stopping  point  in  (24). 

Theorem  5  Under  assumptions  A1-A2,  the  optimization  scheme  (S2)  applied  to  a  particular  sam¬ 
ple  path  of  the  underlying  system  yields  a  frame  which  is  optimal  in  the  discrete  space  5. 

The  proof  can  be  found  in  [6]. 

We  next  present  two  applications  of  this  approach  to  voice  call  processing  in  RNs.  We  first 
consider  the  optimal  frame  design  to  minimize  blocking  in  a  fully  connected  RN.  In  the  second 
application,  we  consider  the  optimal  admission  control  problem  in  a  multihop  RN. 
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9  Optimal  TDM  Frame  Design 


This  application  is  motivated  by  the  need  to  schedule  voice  call  transmissions  (broadcast  mode) 
in  an  i^-node  Radio  Network  [24].  In  particular  consider  a  3-node  RN  and  for  simphcity,  assume 
that  aU  nodes  are  neighbors  of  every  other  node  i.e.,  the  network  is  fuUy  connected.  The  stochastic 
discrete  optimization  problem  is  then  to  select  the  optimal  frame  s‘  to  minimize  Yli=i  PiPi{s)  where 
Pi(s)  is  the  node  i  blocking  probabiHty  operating  under  FD  blocking. 

We  employ  a  gradient  based  optimization  algorithm  (see  [17]),  where  the  parameters  of  in¬ 
terest  are:  (a)  the  observation  interval  (specified  in  terms  of  the  number  of  calls  arrivals)  over 
which  the  derivatives  dPildOi  are  estimated,  and  (b)  the  step  size  T?jt  which  is  used  to  control  the 
adjustment  at  the  kth  update.  In  the  algorithm  considered  here  we  assume  a  constant  step  size 
7y  =  1.0  and  increasing  observation  interval  lengths.  In  particular,  =  Tk-i  -f  C  with  Ti  =  1000  and 
C  =  200  node  1  call  arrivals.  At  the  end  of  the  Arth  observation  interval  we  compare  individual  node 
derivatives  and  set  =  argmin,[dPi/d0i]  and  j"  —  argmaxi[dPi/(i0j].  The  slot  assignment  proba¬ 
bilities  are  adjusted  so  as  to  increase  the  probability  associated  with  I*  and  reduce  the  probabihty 
associated  with  j*. 

In  the  simulation  results  shown  below,  we  assume  a  T\  frame  with  n  =  24  slots,  and  a 
symmetrically  loaded  system  with  Poisson  arrivcds  (A^  =  0.2  V  z  =  1,  ••,3)  and  fixed  call  durations 
of  5  frames.  Thus,  even  though  this  system  is  difficult  to  analyze,  it  follows  from  the  symmetry 
that  the  optimal  frame  is  [8,8,8].  We  considered  three  single-rxm  optinoization  experiments  (with 
different  randomization  vectors  ri,  r2,  ra).  In  each  case,  the  initial  slot  assignment  probability 
vector  is  =  [0.7,0.15,0.15].  Table  1  shows  the  initial  and  final  frames,  as  well  as  the  final  slot 
assignment  probabihties,  where  the  latter  two  are  indexed  by  x,  the  number  of  iterations  on  d  until 
we  first  reach  the  optimal  frame.  After  this  point  we  oscillate  between  the  optimal  aind  one  of 
its  neighbors.  The  oscillatory  behavior  is  typical  of  most  gradient-based  iterative  schemes  and  in 
practice  it  is  easy  to  identify  this  situation  and  select  the  true  optimal  allocation. 


Exp. 

s(°) 

r 

X 

1 

(18,3,3) 

ra 

(8,8,8) 

[0.391,0.261,0.348] 

29 

2 

(20,3,1) 

ri 

(8,8,8) 

[0.292,0.197,0.511] 

30 

3 

(21,1,2) 

r2 

(8,8,8) 

[0.263,0.185,0.552] 

38 

Table  1 :  Frame  Optimization  for  a  3-node  RN 


10  Optimal  Admission  Control  in  Blocking  Networks: 

In  this  apphcation  we  determine  the  optimal  admission  control  policy  to  minimize  blocking  in 
networks  with  fixed  routing  (specified  as  Source/Destination  pairs).  Each  S/D  pair  can  be  viewed 
as  a,  typically  multihop,  circuit  where  the  ith  such  circuit  is  denoted  by  c;.  We  consider  a  4-node 
network  with  5  S/D  pairs  (see  Figme  4a).  We  assume  homogenous  resources  at  each  node,  in 
particular  each  node  in  the  network  has  n  transceivers,  and  such  that  a  transceiver  can  be  used 
for  simultaneously  transmitting  and  receiving  a  packet.  In  tandem  queue  networks  (see  Figure 
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C4 


C5 

Figure  4a:  4-Node  Multihop  RN 


Figure  4b:  3  Class  Polling  Model 
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4),  when  establishing  a  circuit,  we  assiune  that  a  call  needs  to  reserve  a  transceiver  at  the  source 
and  intermediate  nodes  only,  and  not  at  the  destination  node,  which  does  not  have  to  trcinsmit^^. 
Therefore,  in  Figmre  4,  multihop  calls  simultaneously  reserve  the  resource  at  two  nodes  (e.g.,  for  a 
C4  call  we  reserve  a  transceiver  at  nodes  1  and  2),  whereas  all  other  calls  only  reserve  transceivers 
at  one  (source)  node. 

Call  admission  is  concerned  with  the  decision  to  accept  or  reject  a  call.  We  consider  a  simple 
threshold  based  call  admission  policy  where  a  ‘ci  voice  call’  is  accepted  if  and  only  if  there  are  less 
than  ti  calls  currently  active  over  circuit  i.  In  addition  we  require  the  policy  to  be  work  conserving, 
i.e.,  a  Ci  call  is  always  assigned  a  transceiver  if  the  threshold  is  not  exceeded.  Finally  the  thresholds 
ti  are  chosen  so  as  not  to  violate  the  physical  constraints  (limited  number  of  transceivers  per  node) 
of  the  system.  The  latter  can  be  expressed  as  linear  constraints  on  the  thresholds.  The  optimization 
problem  is  then  to  select  the  values  of  ti  so  as  to  minimize  the  system  performance  subject  to  the 
system  constraints 


ti  + 14  =  n 

^2  +  ^4  "I  ^5  =  ^ 

^3  +  ^5  =  n 

To  solve  for  the  optimal  thresholds,  we  convert  the  tandem  queueing  model  to  a  multiclass  poUing 
model.  Let  the  transceivers  be  sequentially  indexed,  and  observe  that  Ci  and  C5  calls  can  be 
assigned  the  same  transceiver  since  their  respective  paths  do  not  overlap.  Therefore,  by  analogy 
with  the  polling  model,  Ci  and  C5  constitute  a  transmission  set.  Similarly  we  can  define  two  more 
transmission  sets  as  T2  =  {ci,C2,C3}  and  T3  =  {03,04}.  The  polling  model  is  shown  in  Figure  4b. 
Our  objective  is  to  select  the  optimal  frame  s“  =  [nj,  n^,  n^]  so  as  to  minimize  the  average  network 
blocking,  where  Ui  is  the  munber  of  transceiver  assigned  to  transmission  set  i. 

Finally,  observe  that  the  threshold  associated  with  any  call  type  is  given  by  the  total  number 
of  transceivers  assigned  to  that  call  type.  That  is, 

ti  =  Tifc 

k  :  ieTk 

Therefore,  the  optimal  thresholds  are  given  by  the  following; 

^2  ~  ^2 

t;  =  nj 
^3  ~  ^2  "i"  ^3 

We  have  performed  2  sets  of  single-rim  optimization  experiments.  In  each  case,  the  initial  slot 
assignment  vector  is  0^°^  =  [0.4, 0.2, 0.4]  and  the  system  is  observed  for  50  parameter  updates.  We 
employ  a  gradient  based  optimization  algorithm  with  a  constant  step  size  =  0.25  and  increasing 

are  in  effect  assuming  that  receivers  are  readily  available,  and  that  only  transmitters  are  a  scarce  resource. 
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observation  interval.  In  particular  =  t*._i  +  C  with  C  =  200  calls.  The  system  parameters  for 
the  experiments  are  given  as: 

Parameter  Set  1:  24  Transceivers  per  Node 

•  Poisson  Arrivals:  Aj  =  A3  =  0.1;  A2  =  A4  =  As  =  0.2 

•  Call  Durations:  t)4  =  =  5;  rji  —  t}2  —  rjs  =  UNI{1,9) 

•  Initial  Observation  Interval  (tq):  2000  Call  Arrivals 


Parameter  Set  2:  24  Transceivers  per  Node 

•  Poisson  Arrivals:  A^  =  0.2  Vi  =  1,  •  •  -  ,5 

•  Call  Durations:  =  5;  Pi  =  t)2  —  Vz  —  UNI{1,9) 

•  Initial  Observation  Interval  (tq):  2000  Call  Arrivals 

Define  the  load  on  circuit  i  to  be  pi  =  Xi/fji  where  rji  =  l/r)i.  In  experiments  1  and  2  we  assume 
24  transceivers  per  node  (equivalently  Tl  links  between  nodes)  and  consider  both  asymmetric  and 
symmetric  traffic  in  the  network  respectively.  Moreover,  for  both  parameter  sets  we  assume  that  C4 
eind  C5  calls  have  constant  duration  (5  frames),  whereas  all  remaining  call  durations  are  uniformly 
(recall  that  we  permit  only  integral  frame  lengths)  distributed  with  mean  5. 

Tables  2  -  6  give  the  system  blocking,  frame  design  and  the  corresponding  slot  assignments 
at  the  nth  iteration,  for  the  ciforementioned  parameter  sets.  For  each  parameter  set  we  consider 
several  initial  frame  configurations  corresponding  to  different  r  vectors.  From  the  results  we  can 
make  severed  observations;  first  for  blocking  networks  with  symmetric  traffic  (i.e.,  pi  is  the  same 
for  each  circuit),  the  optimal  policy  is  to  never  accept  a  C4  or  C5  call  (see  Table  5  -  6)^^.  The 
corresponding  optimal  thresholds  are  therefore  ti  =  tj  =  (3  =  n;  t^  =  t^  =  0.  This  is  to  be 
expected  since  both  C4  and  C5  calls  reserve  a  transceiver  at  two  nodes  along  the  multihop  path, 
whereas  all  other  calls  reserve  only  one  transceiver.  Therefore  by  accepting  a  C4  call  (and  thereby 
reserving  a  transceiver  at  nodes  1  and  2)  we  cire  automatically  blocking  a  Cj  and  C2  call,  whereas 
by  blocking  a  C4  cadi  we  have  the  possibility  of  accepting  two  cadis.  Now  since  since  each  call  is  of 
the  same  priority,  and  the  arrival  rates  are  the  same,  the  optimal  policy  is  never  to  accept  C4  calls. 
A  similar  argument  hold  for  C5  cadis.  However  once  the  load  is  different  on  different  circuits,  the 
optimal  policy  is  no  longer  to  always  reject  multihop  calls  (see  Table  1-3).  Secondly,  6  is  optimized 
conditioned  on  an  initial  vector  r.  Thus,  we  observe  that  although  in  Tables  1  and  3  the  initial 
frame  is  common,  6*  is  different  for  each  case.  However  as  is  conjectured,  the  optimal  frame  is  the 
same  for  each  pair  (0^,rfc). 

conjecture  that  this  observation  holds  true  irrespective  of  iKr  actual  value  of  the  load.  Therefore,  even  when 
Pi  is  sufficiently  smaD  such  that  the  uncontrolled  (i.e.,  subject  to  no  admission  control)  network  can  sustain  all  offered 
traffic,  the  optimal  oplicy  is  to  never  accept  a  a  or  cs  call. 


26 


11  Conclusions  and  Future  Work 


We  have  considered  the  transmission  scheduling  problem  in  an  N-  node  Radio  Network  with  ho¬ 
mogeneous  traffic  (exclusively  voice  or  data).  The  schedufing  problem  is  modelled  as  a  multiclass 
polling  problem  where  a  single  resource  must  provide  service  to  M  predefined  transmission  sets. 
Customers  arrive  in  one  of  several  arrival  streams,  and  a  customer  from  a  particular  arrival  stream 
is  allowed  to  join  one  of  several  prespecified  transmission  sets  associated  with  that  stream.  The 
traffic  Grade-of- Service  requirements  lead  to  different  scheduling  polices,  in  particular,  we  consider 
a  random  polling  pohcy  for  data  traffic  and  a  cyclic  polling  policy  for  voice  traffic.  We  develop 
derivative  estimation  algorithms  and  use  them  in  conjunction  with  a  gradient-based  optimization 
scheme  to  adaptively  alter  the  schedule  (m  a  stochastic  operating  environment)  to  achieve  the 
desired  system  performance.  An  important  feature  of  the  proposed  methodology  is  that  it  is  in¬ 
dependent  of  the  nature  of  the  node  arrival  processes  (and  arrival  rate  information,  except  for 
checking  that  no  stability  requirements  are  violated).  Finally,  for  the  case  of  data  traffic,  we  use 
the  optimal  slot  assignment  probabiUties  to  construct  a  cyclic  or  deterministic  scheduling  policy, 
using  the  Golden  Ratio  policy  [15]. 

In  the  context  of  voice  call  scheduling,  the  proposed  optimization  scheme  can  be  viewed  as  a 
new  approach  to  solve  a  class  of  resource  allocation  problems  with  combinatorially  hard  stochastic 
features.  Also,  the  underlying  ideas  for  derivative  estimation  using  marking  and  phantomizing  tech¬ 
niques  apply  to  general  performance  measures  -  not  just  the  waiting  times  or  blocking  probabilities. 
Therefore,  estimates  of  more  general  performance  measures  (e.g.,  probability  that  a  customer  delay 
exceeds  some  deadline,  or  probability  that  the  queue  length  at  a  node  exceeds  some  value)  can 
also  be  obtained.  This  raises  the  interesting  possibility  of  investigating  schedufing  problems  invol¬ 
ving  traffic  classes  with  different  performance  requirements,  an  issue  of  considerable  importance  in 
networks  designed  to  support  voice,  video  and  data  (see  [24]). 

Another  natural  next  step  for  our  work  is  to  address  the  problem  of  routing  in  multihop 
radio  networks.  This  can  be  done  by  defining  appropriate  transmission  sets  and  schedufing  packet 
transmissions  accordingly.  Although  this  problem  becomes  considerably  more  difficult  when  the 
network  combines  both  voice  and  data,  we  believe  the  same  basic  approach  described  in  this  report 
can  be  applied. 

Finally,  it  is  obviously  of  great  interest  to  investigate  distributed  implementations  of  the 
various  algorithms  we  have  presented  for  trcuismission  schedufing.  We  believe  this  is  indeed  possible, 
but  have  left  this  resesirch  direction  for  future  work. 
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Experiment  1:  T1  Link  with  Asymmetric  Traffic: 


Para.  Set 

r 

n 

mm 

mM 

1 

la 

0 

(14,4,6) 

[0.400,0.200,0.400] 

1 

ri 

10 

(7,11,6) 

[0.202,0.398,0.400] 

0.510 

1 

20 

(6,12,6) 

[0.187,0.456,0.357] 

0.509 

1 

ri 

30 

(6,12,6) 

[0.153,0.508,0.339] 

0.508 

1 

ri 

40 

(5,14,5) 

[0.127,0.546,0.327] 

0.506 

1 

(5,14,5) 

[0.124,0.550,0.326] 

0.508 

Table  2;  Optimization  of  4-node  Tandem  RN 


Para.  Set 

r 

msm 

1 

rz 

0 

(10,5,9) 

[0.400,0.200,0.400] 

0.513 

1 

r2 

10 

(8,9,7) 

[0.264,0.421,0.315] 

0.512 

1 

(7,11,6) 

[0.208,0.542,0.250] 

0.511 

1 

r2 

30 

(6,12,6) 

[0.149,0.612,0.239] 

0.507 

1 

r2 

40 

(5,14,5) 

[0.145,0.631,0.224] 

0.507 

1 

(5,14,5) 

[0.143,0.634,0.223] 

0.506 

Table  3:  Optimization  of  4-node  Tandem  RN 


Para.  Set 
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n 

msm 

G8II 

1 

ra 

0 

(14,4,6) 

[0.400,0.200,0.400] 

0.538 

1 

rs 

10 

(6,12,6) 

[0.174,0.426,0.400] 

0.508 

1 

rs 

20 

(6,12,6) 

[0.160,0.482,0.358] 

0.509 

1 

30 

(5,13,6) 

[0.133,0.533,0.334] 

0.507 

1 

40 

(5,13,6) 

[0.135,0.582,0.283] 

0.507 

1 

ra 

44 

(5,14,5) 

[0.137,0.594,0.269] 

0.509 

1 

ra 

50 

(5,14,5) 

[0.137,0.595,0.268] 

0.508 

Table  4:  Optimization  of  4-node  Tandem  RN 
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Experiment  2:  Tl  Link  with  Symmetric  Traffic: 


r 

n 

mBsm 

Q8II 

2 

la 

0 

(14,4,6) 

[0.400,0.200,0.400] 

0.579 

2 

la 

5 

(6,13,6) 

[0.155,0.445,0.400] 

0.516 

2 

la 

10 

(4,16,4) 

[0.080,0.640,0.280] 

0.499 

2 

Tl 

15 

(0,21,3) 

[0.000,0.784,0.216] 

0.479 

2 

o 

20 

(0,21,3) 

[0.000,0.876,0.124] 

0.471 

2 

Tl 

25 

(0,21,3) 

[0.000,0.935,0.065] 

0.479 

2 

ri 

30 

(0,24,0) 

[0.000,0.995,0.005] 

0.469 

Table  5:  Optimization  of  4-iiode  Tandem  RN 
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n 

msm 

G8II 

\mam 

0 

(10,5,9) 

[0.400,0.200,0.400] 

0.567 

2 

5 

(8,9,7) 

[0.257,0.442,0.301] 

0.541 

2 

r2 

10 

(5,14,5) 

[0.131,0.653,0.216] 

0.508 

lam 

rz 

15 

(0,20,4) 

[0.060,0.824,0.116] 

0.483 

rz 

20 

(0,23,1) 

[0.060,0.930,0.010] 

0.473 

IBBH 

(0,24,0) 

[0.060,0.640,0.000] 

0.471 

Table  6:  Optimization  of  4-node  Tandem  RN 
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